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ABSTRACT 


The primary objective of this study is to determine 
relationships that exist between production cost and the state 
of the art of technology and extensions in technology for 
high-technology systems. The data sample selected for study 
was U.S. military tactical aircraft. 

The central methodology used in the analysis of the air- 
craft data base included: 

1. The development of measures for the state of the art of 
technology and the level of technology advance that 


exists within U.S. fighter and attack aircraft programs. 


2. The development of measures for each aircraft program's 
production cose 


3. The application of various statistical procedures 
(regression analysis) to test specific hypotheses and 
build models to explain the relationships between 
technology and vcece-, 

General conclusions from this study are that significant 


relationships do in fact exist between aircraft production 


cost and specific technology measures. 
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I. INTRODUCTION 


eel dbo LS OBJECTIVE 

The purpose of this thesis is to test for specific 
relationships between measures of the state of technology in 
complex aircraft systems and the production cost of those 
systems. | 

The benefit of this analysis is in establishing relation- 
ships between technology and cost. Knowledge of such 
relationships is necessary to determine future production 
costs for aircraft technology advances. 

This thesis topic is designed as an extension of a project 


completed by Dr. Willis R. Greer, Jr., A Method for Estimating 


and Controlling the Cost of Extending Technology, Naval 
Postgraduate School, Monterey, CA. Dr. Greer's project 


analyzed the relationships between measures of technology (and 
technology advance) and the research and development costs for 
advanced satellite projects. 

This study conducts an analysis Similar to Dr. Greer's, 
but differs in two ways. First the sample consists of U.S. 
military tactical aircraft and their sub-systems. Second, 
this study emphasizes the relationships that exist between 
technology and production costs. 

The primary purpose for testing these relationships is to 


develop models describing how costs are affected by extensions 


in technology. These models can be used for projecting 
production costs as technologies advance. 

Additionally, this thesis provides an understanding of 
What measures of technology can be created and how those 
measures serve to explain cost. This goal is accomplished by 
describing how the state of the art and advances in technology 
are measured. 

The data base for this study was developed from selected 
data contained within The US Military Aircraft Cost Handbook 
developed by The Analytic Sciences Corporation, Arlington, 


Virginia. 


IB BACKGROUND 

This thesis, being an extension of Dr. Greer's work, capi- 
talizes on many of the same technology measures and 
methodologies employed by Dr. Greer. The major difference 
between Dr. Greer's work and this thesis is in the methodology 
used to create technology measures. 

Both studies utilize regression analysis techniques for 
testing the individual data bases to develop optimal models. 

Dr. Greer used three technology measures, REACH, DESIGN 
and ADVANCE, to t .t for interrelationships between technology 
and cost. This study builds on the concepts introduced by Dr. 
Greer, but using an alternative approach, creates three 


technology measures, REACH, STAND and ADVANCE. Relationships 


between those three measures and production cost form the 
central area of analysis for the study. 

Dr. Greer found that his initial raw cost data for 
satellite systems was neither linear nor normally distributed. 
This thesis will report results of tests performed to 
determine the statistical properties of the variables used in 
the analysis of aircraft data sets and apply specific 
statistical procedures to correct any pre-existing problems. 

Dr. Greer's work resulted in specific regression models 
which defined the relationships between satellite cost and 
technology measures. The major problem which detracted from 
the findings of his study was the lack of a larger data base. 
Dr. Greer only had 17 satellite systems to work with. That 
may have negatively impacted the performance of his models. 

This thesis is based on 47 solid sets of aircraft data 
from which to create technology measures and 38 data sets from 
which to test technology cost relationships. Thirty data sets 
is considered the minimum for untainted data within regression 
analysis. Accordingly, the problem faced by Dr. Greer, was 
effectively eliminated for purposes of the tests performed 


during this thesis work. 


See REOEARCH METHODOLOGY 
Two research methodologies, archival and analytical, have 


been utilized to select and analyze the data developed within 


this thesis. The following describes ieaitesen method was 
used. 
1. Archival Research 

Archival research was employed to create a data base 
of measures of performance of aircraft systems. The data base 
was screened for consistency and included selected available 
Gata for U.S. military aircraft produced from 1950 to d9eme 

Additional archival research was conducted to create 
a production cost data base for those aircraft selected for 
study. The production costs that were developed included 
total aircraft flyaway costs as well as specific sub-system 
costs. 

2. Analytical Research 

Analytical research was conducted to create and 
justify measures used to reflect aspects of technology and 
PECAGUCL Tone costa. 

Multiple hypotheses concerning technology, technology 
advancement, time, and production costs were developed and 
statistically tested. 

Logic was then applied to develop descriptive models 
and conclusions concerning relationships between aircraft 


teciiology and proedwction costs. 


D. THESIS ORGANIZATION 
Chapter II provides a detailed description of technology 


measurement, what the measures of technology are and how they 


are derived. This task is accomplished by conducting an in- 
depth review of Dr. Greer's research and extending the 
applicable theories to a refined methodology relevant to this 
study. 

Chapter III describes aircraft production costs and their 
measurement. This chapter reviews the problems and the pro- 
cedures for measuring production costs and develops 
measurement standards to be applied to the data base. 

Chapter IV discusses the data collection and selection 
procedures employed in developing the data base. The process 
describes the complexity of the initial sample selection and 
how consistency within the data base was developed by 
rejecting various observations. Following this process, the 
final data tables for both costs and technology within a 
system are presented. 

Chapter V provides the procedures used in the development 
of the three technology measures, REACH, STAND and ADVANCE. 
Developing these technology measures was essential to the 
advancement of the central hypotheses of this study. 

Chapter VI details the data analysis procedures used to 
test specific hypotheses. These statistical tests addressed 
the central research question: What relationships exist 
between technology and production costs? Regression models 
were constructed to separately address the central research 
question in the context of various subsets of the data base. 


These include three categories of aircraft: 


1. All aircraft in“the sample: 

2. New aircraft designs. 

3. New series of existing aircraft designs. 
These also include four categories of cost: 


1. Airframe cost. 


2. Airframe plus engine cost. 
3. Avionics and weapon system cost. 
4. Flyaway aircraft cost. 


Chapter VII presents a summary of the results, the final 


conclusions and recommendations. 


II. TECHNOLOGY MEASUREMENT 


This section will provide a detailed overview of how tech- 
nology can be measured and applied to state of the art (SOA) 
advancement. The primary emphasis of this chapter will 
include a description of what technology measures are and how 
they are derived. In short, the concern is with methodologies 
for creating technology SOA measures. 

The discussion of technology measurement will include a 
review of the study conducted by Dr. Greer based on technology 


extensions for the satellite industry, A Method for Estimating 


the Cost of Extending Technology. Dr. Greer's study and 
research concepts will then be compared to a separate 


technology measurement approach developed and applied to 
military aircraft by The Analytic Sciences Corporation (TASC), 
Arlington, VA., (the TASCFORM-AIR Model). 

The calculation of technology measures and the extension 
of the State-of-the Art (SOA) technology are essential 
components to accurately developing cost models that predict 
Research & Development and defense program contract costs. 
Currently, technology measurement 1S a non-standardized 
science. This problem could adversely affect much needed 
defense programs which are on the leading edge of technology 


development. 


The current system of military SOA advancement and program 
management includes constant financial risk and uncertainty. 
Industry leaders and Department of Defense (DOD) program man- 
agers do not agree on a single methodology for predicting 
these measures and cost. Data bases are incomplete and error 
filled (Ref. l:pp. 1-6--1-8]. The failure to produce accurate 
measures of technology advancement has resulted in extensive 
cost overruns and corporate financial uncertainty, as well as 


program termination. 


A. TECHNOLOGY VARIABLE SELEBCGiie! 

Technology measurement variable selection should begin 
with an in-depth review of the physical characteristics and 
capabilities for the system under study. This phase of the 
research shotld only be conducted by researchers having in- 
depth technical knowledge of the system being reviewed. 

The initial selection of characteristic and capability 
variables generally includes those factors which represent 
Significant historical developments embodied in the state-of- 
the-art technology, including desired technological advances 
anticipated from the system design and engineering process. 

For purposes of this thesis the steps in technology mea- 
surement methodology can be broken down into four broad steps: 

1. Identification of the systems under study. 


2. Identification of individual dimensions of technologe 
within particular systems. 


3. Combining the individual technology dimensions of 
interest into a single measure of SOA of technology 
embodied in any individual system. 


4. Comparisons of the SOA measure between different systems 
(e.g., a predecessor system and a new system under 
development) or over time to create measures of the 
extension in the SOA of technology from one point to 


another. In the following discussion, these steps are 
reviewed as they apply to the approach adopted by Dr. 
Greer. 


iS. DR. GREER'S TECHNOLOGY MEASUREMENT METHODOLOGY 
1. Step 1: Identification of Systems 
Dr. Greer's study focused on satellites of all types; 
Navigation, Communication, Intelligence. His sample consisted 
of 18 satellites launched from 1966 to 1986. 
2. Step 2: Identification of Technology Dimensions 
Bic. Greer originally set three criteria for 
identifying relevant variables to reflect dimensions of 
technology: fRef. 2:p. 48] 


1. Variables which are generally accepted to be influenced 
by engineering developments. 


2. Variables specified in ascending value so that the 
higher the technological advance the higher the SOA 
value. 


3. Variables which are readily identifiable during the 
R&D phase of the systems life cycle. 


Air Force satellite project managemant personnel rely 
on 85 physical characteristic variables to analyze a satellite 
project. With the help of subject matter experts these data 
fields were reduced to 18 variables relevant to describing 


dimensions of technology. 


Dr. Greer's 18 composite variables described specific 
design objectives of satellite technology and eliminated those 
characteristics which were by-product characteristics of the 
design and engineering process. The selected variables 
reflected such properties as: launch method, design life, 
propellent, battery capacity, maximum temperature and nuclear 
hardening (Ref. 2:pp. 49-50]. 

Eighteen separate dimensions or variables were too 
many to work with (given only 18 satellite systems in the data 
set). Hence some procedure for reducing the number of 
variables was necessary. Factor analysis, a statistical 
procedure commonly used to identify "commonality" among 
individual variables, was used by Greer. The factor analysis 
procedure demonstrated that the variables were "clustered" 
into four distinct factors with 81.7% of the vamijeumee 
explained. These four established factors were labeled under 
the titles: Mission, Orbi tals Electrical Power, and 
EnVirbonment [Ref 22) praocue 

Factor scores for each of the 18 satellite systems on 
these four factor dimensions were determined. These factor 
scores were then used as the four basic dimensions of 
technology in subsequent analysis. These factor scores can be 
combined in various ways to reflect the overall technology 


embodied in a particular system. 
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3. Step 3: Combining Technology Dimensions into SOA 
Measures 


This next step relied on an innovative methodology 
identified by Dodson and Graver [Ref. 3:p. 39]. Using the 
four factor scores as basic technology variables an ellipsoid 


of the following form was fit to the data: [Ref. 2:p. 61] 


2 
ao x 
1 Zz 3 I ee 
——e— + t+ set ieee +t RSE l 
é A ‘ A A e 
“Tl 2 3 n 
where: 
X, = Factor Scores (adjusted); 
A, = Parameters determined by the ellipsoid fitting 
procedure. 


The result was an "average" SOA measure of "1" for the sample 
of satellites, represented by the four dimensional ellipsoid 
hypersurface. The effect of fitting the hypersurface to the 
data is to create SOA measures in four dimensional space which 
are independent of the scores of the original variables. 

The level of SOA technology embodied in each satellite 
was then determined by inserting the factor scores for each 
satellite into the industry technology ellipsoid model. The 
technolugy measure for each satellite is then described as the 
distance from the origin to the data point and is a function 


mmene fOur distinct measuredwesconess« 
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4. Step 4: Create Measures of Technology Extension 


A general measurement concept was then defined, called 
technology distance, which permits the measurement of distance 
between any two points within an N-dimensional space. Greer's 
four factor scores defined a 4-dimensional space (within which 
the ellipsoid surface representing the SOA of technology was 
fit). Using the idea of technology distance, Greer created 
the following measures relevant to capturing technology 
complexity and extension [{Ref. 2:p. 78]: 


1. Reach--The technological complexity of the development 
project. 


2. Advance--The improvement or the "True" SOA progress 
required (from predecessor systems). 


3. Redesign--The parallel movement along the old SOA plane 
to the desired project level (reflecting trade-offs 
between the four technology dimensions). 

A search for statistical associations was then 
conducted to determine predictable technology development 
costs. Two factors were considered: (1) the degree to which 
a systems's technology was extended, and (2) the level of 
activity (time and cost) required to complete the extension. 

Regression analysis was then used to test a "time" 
hypothesis resulting in the advance measure being highly 
Significant in explaining development time. Neither edesign 
nor reach were statistically significant. 

A second hypothesis was tested (using regression 
analysis) for relationships between cost and time. This 


hypothesis tested what happens to cost aS a program is 


li2 


extended beyond its scheduled completion date or is ac- 
celerated for early completion. Regression analysis 
demonstrated that both "natural" development time (predicted 
time to completion) and deviations in development time 
(residual time) were significant in explaining cost. 

The outcome of Dr. Greer's study was a workable 
methodology for measuring the level of technology embodied in 
complex systems and relating those awiorvogy measures to 


development cost. 


C. TASCFORM-AIR TECHNOLOGY MEASUREMENT METHODOLOGY 
The TASCFORM-AIR Model data base was developed to advance 
theories of U.S. vs Soviet war-time mobilization capabilities 
and costs. This data base was reviewed and determined to be 
directly applicable to advancing theories on peace-time 
production and R&D cost relationships. The four broad steps 
in technology measurement as applied to the TASC data are 
outlined as follows. 
1. Step 1: Identification of Systems 
The mission organization was initially determined to 
be all U.S. military aircraft produced between 1950 and 1980. 
Due to the lack of available technological data, the scope of 
the project was reduced to 128 Tactical Air Community 
Mirerait, TACAIR. Ultimately, the project was again refined 
‘The Tactical Air Community, TACAIR, includes two primary 
mission definitions; air-to-ground support (AG) and air-to-air 
combat support (AA). These two mission areas include: 
fighters, bombers, interceptors and attack helicopters. 


i I 


to a data set of 91 aircraft due to incomplete historical 
project cost records. 
2. Step 2: Identification of Technology Dimensions 
The preliminary technology describing characteristics 
for each aircraft were collected from "Standard Aircraft 


Characteristics Charts" available in Jane's All The World's 


Aircraft (Franklin Watts, Inc., et. al., 1954-1980). The 
physical characteristics included the following data: [Ref. 
4:p. II-5] 


1. Manufacturer. 

2. Wing Type (Fixed/Rotary). 

3. ALMCrate ype. 
a. CTOL--Conventional Takeoff and Landing; 
b. VSTOL--Vertical/Short Takeoff and Landing; 
c. STOL--Short Takeoff and Landing; 

4. Engine Designator. 

5. Number of Engines. 

6. Branch of Service. 

Eight airframe/propulsion variables and 11 weapons 
system and avionics variables were also collected to address 
specific aircraft technology characteristics. Select DOD 
subject matter experts made the detern-nation as to which 
technology variables best represented aircraft design and 


engineering features desired in military aircraft. 


Note: some aircraft models have multi-mission capabilities 
and combat roles. 
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Two figure of merit data base tables were then con- 
structed to describe technology measures for the TASCFORM-AIR 
Model: [Ref. 4:p. III-1] 

1. TASCFORM-AIR Airframe Performance (AP). 

2. TASCFORM-AIR Aircraft System Performance (ASP). 

These two TASCFORM-AIR Model SOA technology data bases 
are the central core for this study of technology measurement. 
In order to best understand what the AP and ASP figure of 
merit calculations represent, a review of their development 
methodology is necessary. 

All TASCFORM-AIR Models use basic airframe/propulsion 
characteristics normalized relative to a baseline aircraft, 
the F-4B, as the basis for the figure of merit. 

Airframe/propulsion characteristics include the 
following variables: (Ref. l:pp. 2-6, 2-7] 

1. Payload (PL) expressed in pounds of stored station 
capacity plus weight of any gun and ammunition carried 
in ground attack, and in number of air-to-air ordnance 
stations, including 1 for an internal gun, in air-to-air 
combat. 

2. Range, including enhanced responsiveness conferred by 
V/STOL and STOL basing modes (R+BF) maximum range for a 
clean aircraft, using internal fuel only to fly a Mil-c 
profile’, with an additional basing factor of 500 
nautical miles (NM) for VTOL capability, 250 NM for STOL 


capability, and 100 NM fer CTOL or V/STOL carrier 
capability. 


*“Mil-C Profile refers to an early 1980's flight perfor- 
mance description for USAF & USN tacair aircraft. It was used 
to describe a combination of high altitude vs low altitude 
enroute flight plans for various mission profiles. 


tS) 


3. Maneuverability (M) expressed in terms of its ability to 
change direction, altitude, or airspeed, represented by 
maximum specific power for fixed-wing aircraft. 

4. Useful Speed (V) expressed as maximum indicated airspeed 
in knots, at sea level, in the air-to-ground roles, and 
as best mach, at all altitudes, in the air-to-air role. 


3. Step 3: Combining Technology Dimensions into SOA 
Measures 


Aircraft performance values were expressed as a 


function of each variable: [Ref. l:pp. 2-6, 2-7] 


AP = f(PL,R+BF,M,V) 


Specific weighted values were applied to each variable 
by a conference committee of select DOD subject matter experts 
(operationally-experienced aviators). These weighted values 
were based on judgmental comparisons of the relative impor- 
tance of each system characteristic as it contributes to one 
of the specific tacair roles. The weighting values received 
extensive review and modification by all branches of the 
military, reflecting a balance of desired characteristics as 
they applied to each branch and their unique combat operating 
environment. This weighting process corresponds to real world 
operational methodology wh determining how to employ each 
multi-mission aircraft. 

Each value was then divided by the corresponding 


baseline category value for the F-4B. This provided the 
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comparative basis for each aircraft's figures of merit [Ref. 
EO... Ps |e 
The airframe performance figures of merit were then 


transformed into an additive expression vice a multiplicative 


EanAection. The mathematical expression for the AP mission 
oriented figures of merit became: [Ref. l:p. 2-9] 
AP = F(PL)*PL + F(R)*(R+tBF) + F(M)*M + F(V)*V 


where F(PL), F(R), F(M), and F(V) represent the judgmental 
weights. 

Aircraft System Performance (ASP), the second major 
TASCFORM-AIR SOA technology measure, was derived by 
additionally accounting for weapons and avionics 
characteristics employed by each aircraft. These calculations 
reflect the tactical impact each system has on airframe/ 
propulsion performance when expressed as a function of the AP 
figure of merit. 

Three “master" weapons system and avionic variables 
were used to modify the AP equation. These variables were: 
fee spp. 2-13=-2-28 } 

1. Payload Utility (PU) a payload modifier, adapts the 
performance measure to target acquisition and engagement 
capabilities. For specific information on how PU was 
calculated refer to The TASCFORM-AIR Model, TR-1334-3. 

2. Navigation Coefficient (NAV) modifies the range capabi- 


lity by rating various internal navigation systems as 
either poor, good, or excellent. 


iy 


3. Survivability Factor (S), a variable of Major Siqmecee 
cance, modifies all variables. It is defined as a 
susceptibility to detection, identification, and lock- 
on tracking and reflects the probability of being 
destroyed once hit by hostile fire. 

The application of the aircraft system performance 
variables to the AP equation produces the ASP technology 


measurement: [Ref. l:p. 2-16] 


ASP = (F(PL)*PL*PU + F(R)*(R +BF)*NAV + F(M)*M + F(V)*V) * S 


Like the AP measure, ASP has been normalized to the F- 
4B baseline aircraft and produces a decisive figure of merit 
rating system for each aircraft studied. 

4. Step 4: Creating Measures of Technology Extension 

The major technology measurement concept difference, 
between Dr. Greer's study and this study, is that the 
TASCFORM-AIR Model utilizes a single axis/dimension figure of 
merit to describe technology, vice the four axis ellipsoid 
model used by Dr. Greer. The use of a single axis/dimension 
figure of merit can be used to reflect the essence of Dr. 
Greer's technology extension measurement concepts, except for 
the redesign feature. The advance and reach concepts are 
applicable to -his study and will be fully explored in Chapter 


WE 
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D. SUMMARY 

This portion of the study shows the complexity of 
technology measurement. It reviewed the necessary steps in 
creating measures to reflect the SOA of technology and 
extensions in technology. It reviewed the specific steps used 
to create SOA measures for the aircraft that will be studied. 

The specific aircraft performance and aircraft system 
performance data base figures of merit embires for this study 
are available in the Appendix. 

The remainder of this study will focus on a methodology 
for applying the TASCFORM-AIR technology measures and data 
base figures of merit. This will be accomplished by advancing 
theories on relationships between aircraft production costs 


and the extension of technology in aircraft. 
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III. PRODUCTION COSTS AND MEASUREMENT 


This chapter will describe the methodologies and 
procedures for measuring production costs. The primary objec- 
tive is to provide a consistent set of cost measures that when 
related to the TASCFORM-Air model aircraft performance 
measures, can be used to test for relationships that may exist 
between technology and aircraft system cost. All aircYraee 
cost data were taken from the US Military Aircraft Cost Hand- 
books i Ret a Sim 

This chapter first reviews the collection and adjustment 
procedures used in creating the basic cost data contained in 
the US Military Aircraft Cost Handbook (Steps 1-3, to follow). 
The chapter concludes (Step 4) by describing the development 
of the specific cost measures that will be used in later 


analysis. 


A. METHODOLOGY, PROCEDURES AND PROBLEMS 
1. Step 1. Data Collection 
The cost data for the aircraft contained within this 
¢ dy was generated by the Air Force and Navy from each 
service's historical data files. The cost information was 
provided on the basis of each Mission/Design/Series aircraft 
and -included: .«{ Ref. 75: pee Gr—wa) 
1. The total procurement quantities by specific annual 


fiscal year. 
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2. The total flyaway costs or total obligational authority 
(TOA) in specific then year dollars. 


Bere brcakdown ot total E£lyaway Costs for each aircraft by 
the major categories of: 


a. Airframe; 
b. Engines; 
CoE TeCeroOnrTes; 
d. Armament; 
e. Other. 
2. Step 2. Develop Consistency within the Data Set 

In order to use the data appropriately in any future 
tests, the data had to first be evaluated for completeness and 
consistency. 

Not all the data collected in step 1 could be fully 
utilized. The Department of Defense (DOD) historical cost 
data files contained multiple inconsistencies, such as lack of 
uniformity within the Research & Development cost records. 
Additionally, DOD standards did not exist for the 
determination of aircraft system modification and conversion 
costs. Therefore, these cost data items were eliminated from 
mie data base [Ref. 4:p. II-7]. 

Cost reporting standards within each service changed 
over time in compliance with specific DOD management 
objectives. This caused variations in the historical cost 
data which required extensive review and some adjustments. 
Since 1970, DOD cost reporting standards have been refined, 


resulting in more precise historical cost data. The in-depth 
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review of the pre-1970 data produced the following 


adjustments: (Ref. 4:pp. II-7--II-12] 
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The primary area of concern for the reporting standards 
was nonrecurring costs. Initial tooling was listed as 
Research Development Test and Evaluation (RDT&E) for 
some DOD aircraft, while other aircraft programs listed 


it as production cost. The Air Force data had three 
aircraft data sets where nonrecurring costs were 
reported separately, the A-10A, F-15A, F-16A. This 


problem was also evident in the post 1969 Navy data. 
After 1969, all Navy data files began listing 
nonrecurring cost separately. To promote consistency 
within the entire data base, nonrecurring costs were 
included in the total flyaway costs for all aircraft. 


The second area of concern was the individual inconsis- 
tencies which existed within each service's data. The 
following minor deviations were noted: 


a. During FY51-FY55, the Navy only reported unit costs 
and total number of aircraft produced. This 
required the unit cost to be multiplied by the 
number of aircraft to develop the subsystem and 
total flyaway costs for that period. 


b. Seven Air Fori::e aircraft data sets were incomplete 
with respect to the breakout of major subsystem 
costs. These aircraft are F-105D&F, F-111A/D&E, FB- 
111A and the ya—4e.; 


c. Missing historical cost data for some aircraft 
resulted in missing cost measures. 


These adjustments provided a relative consistency 


among the total flyaway cost data and the subsystem costs. 


Step 3. Inflation Indexing 


Once the consistent categories of cost data were 


established, the historical cost data had to be adjusted from 


individual then-year dollars to constant dollars. 


An inflation escalation index provided by the Office 


of Assistant Secretary of Defense, Comptroller, was applied to 
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PiemeOcmecdawea Dase [Ref. 4:pp. LLI-1--IiiI-7]. This procedure 
"normalized" the cost figures and produced cost figures infla- 
tion-adjusted to the base year, FY1981. The end results are 
relative cost figures that can be computed across aircraft 
much the same as the performance "figures of merit." 
4. Step 4. Developing Cost Measures 

After the consistency adjustments and inflation 
indexing procedures were conducted, the available raw data 
consisted of cost and quantities per lot for each aircraft. 
Comparisons of cost per lot or average cost per lot across 


aircraft systems was deemed to be inappropriate for this study 


because: 
1. Production lots consisted of different quantities, and 
Bee Gost reduction occurs due to a number of factors, but 


typically within the aircraft industry as more lots are 
produced the "learning curve" reduces average cost per 

ILofear 
It was decided to create a single average cost figure 
at a consistent quantity point which would reflect the cost 
reduction that occurs due to learning. The following 


procedures were conducted to arrive at a cumulative average 


cost (CAC) of producing 100 units: [Ref. 4:pp. III-7--III-16] 


1. Cumulative quantities at the end of each lot were 
determined by summing the quantities in all preceding 
lots. 

2. Cumulative average costs (FY81) at the end of each lot 


were determined by summing the costs of all preceding 
lots and divided by the cumulative quantities. 


3. Learning curves were then developed and fit to the 
cumulative average costs and quantities. Regression 
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analysis procedures were used resulting in the following 
cumulative average cost curve equation: 


Cy SB 
where: 

Cg = Cumulative average cost for a quantity Q. 

A = Constant, the first unit cost (estimated by the 
fitting procedure). 

Q = Cumulative quantity. 

B = Constant, the slope or learning rate. 
(Estimated by the fitting procedure. ) 

4. The cumulative average cost of 100 units, CAC (100), was 


determined by setting Q at 100 and re-entering the 
learning curve to solve for Cp. 


The methodology employed is unique but provides for 
comparable average cost figures at a comparable quantity for 
all aircraft. The primary consideration is the different 
learning rates experienced on individual aircraft programs. 

This methodology was conducted on three separate cost 
series: airframe costs, airframe plus engine costs and total 
flyaway costs, and four variables resulted: 

1. CACF--CAC (100 units), airframe. 


2. CACE--CAC (100 units), airframe plus engines. 


3. CACA--CAC (100 units), flyaway. 


4. CACS--CAC (100 units), avionics plus weapons systems, 
calculated as: CACA - CACE. 
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B. SUMMARY 

When dealing with cost and performance measures, one must 
realize that both are related to the quantity or lot size of 
the aircraft produced. Aircraft are not purchased singly but, 
rather in lots of varying quantities. Generally, investment 
and production costs are lower per unit for large production 
lots than for low outputs such as experimental or RDT&E 
aircraft. | 

This chapter discussed the effects of learning curves on 
aircraft cost data. Performance measure variables also 
improve as the production learning curve improves. The larger 
the lot size, the more reliable the performance measures 
become. This standard is attributed to improved production 
techniques developed over the production cycle and system 
reliability generated from modifications incorporated during 
production. Simplistically stated, aircraft models of small 
lot size have no opportunity for redesign or modification due 
to the limited production cycle time. Large lot aircraft 
production cycles have more opportunities through time to 
incorporate production modifications that enhance’ the 
performance measures of the original design. This study 
includes the effects of production modifications and their 
costs. 

One limitation of this study is the absence of explicit 


consideration of the effects of external production factors, 
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such as after delivery modifications to aircraft systems, on 
Produce 1 onmcosite 

Most aircraft models and subsystems undergo extensive 
modification and update throughout their life cycles. 
External research has shown that some aircraft subsystems 
receive after delivery performance improvements and 
modifications that more than triple their capabilities. Both 
the cost and effect of after production modifications have 
Significance when including their impact on the advance of the 
SOA within the industry. 

The uninformed reader may wrongly conclude that the 
average unit flyaway cost or subsystem cost are only related 
to prior industry design preducticnmcec.-- In reality, 
average unit flyaway cost and subsystem costs are affected by 
many external factors. Further research is recommended to 
determine what external production factors exists within the 
aircraft industry and what effect they have on advancing SOA 
cost relationships. 

The specific tests for relationships between the cost 
measures and the performance measures will be fully explored 
in Chapter V. The cost measure data fields can be found in 


the Appendix. 
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IV. DATA COLLECTION 


This chapter will describe the sample selection and data 
collection procedures for creating this study's aircraft data 
base. The selection process will list the systems to be 
included in the analysis and describe what systems were 
rejected and why. From the selection process, data 
presentation tables for both costs and technology within an 
aircraft system will be developed. 

The original scope of this study was all US military air- 
craft. Due to scope restrictions and limited availability of 
data, the US Military Cost Handbook [Ref. 5], was selected as 
the primary source document for selecting a sample of aircraft 
and developing a data base of aircraft costs and performance 


measures. 


A. TASC DATA BASE 

The cost handbook contains a broad-based, but not all in- 
clusive sample of 108 data sets of US TACAIR aircraft that 
were produced from 1950 to 1980. This study was conducted by 
The Analytic Sciences Corporation (TASC) under a Department of 
Defense, Office of Net Assessment, contract. The study 
explored cost vs performance relationships iOjs the 
mobilization of U.S. forces during a theoretical national 


emergency with the Soviet Union. The TASC study contains 
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extensive data on aircraft performance and cost. These 
factors were considered ideal for advancing this study's 
research questions. 

All 108 aircraft data sets were identified by mission 
(fighter, attack, bomber, patrol, etc.), design, and series 
(e.g., B-52¢C, F=-14A, A-7D) Where successive series of a 
particular alnerare design resulted nel virtually 
indistinguishable aircraft, the handbook combines different 
series aircraft into a single combined series (e.g., A-7A, A- 
7B became A-7A/B) and additionally provides a data set for the 
combined series. Data for 48 individual aircraft were 
combined into 20 separate multiple-series data sets, resulting 


in a total of 128 data sets¥avai lable. 


B: DATA SELECTION ERSCEDURES 

It was determined that the TASC's sample of 128 data sets 
could be reduced to eliminate repetitive data and tactical 
aircraft of dissimilar characteristics, mission and flight 
profiles. The following methodology was employed to reduce 
the sample. 

The 20 "multiple-series" data sets were analyzed and 
determined to be complete; they adequately includ . all the 
desired performance and cost measures. To eliminate the 
duplication of data, the 20 "multiple-series" sets were 
retained. The 48 individual aircraft data sets included in 


the "multiple -series" data, were dropped from this study's 
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data base. This procedure reduced the number of distinct 
aircraft programs to 80. 

Performance characteristics and mission profiles were then 
analyzed to ensure consistency within the data base with 
respect to the performance measures. To be more specific, the 
performance measures used in this study rely on the F-4B as a 
baseline aircraft. It was decided that the performance 
measures for aircraft would be most valid and most comparable 
if all aircraft in the sample had: 

1. Similar missions descriptions as the F-4B. 

2. Similar operating characteristics as the F-4B. This 
idea lead to deletion of additional aircraft data sets 
as follows. 

Mission profile was used to eliminate dissimilar aircraft 
data sets. Since the F-4B was a dual mission aircraft 
(fighter and attack) aircraft serving all other mission 
profiles were eliminated. This procedure resulted in 
eliminating 19 individual aircraft data sets (strategic 
bombers and patrol aircraft) and reduced the number of 
Sie~einct alrcraft programs to 61. 

Performance and flight profile relationships were then 
evaluated relative to the F-4B to eliminate dissimilar 
aircraft data sets. The F-4B being a conventional takeoff- 
and-landing flight profile aircraft (CTOL) was determined to 
be important. Performance and technology characteristics are 
directly related to the individual aircraft's takeoff-and- 


landing flight profile. This analysis resulted in eliminating 
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one short field takeoff-and-landing aircraft (STOL) ana sea 
vertical takeoff-and-landing aircraft (VTOL). Fifty-five 
distinct aircraft programs remained. 

The last adjustment to the data base was centered on the 
relationships between successive series of aircraft and 
specific advances in technology incorporated within each 
successive series of the aircraft produced. Some later series 
of aircraft models demonstrated significant advances in 
technology, while others demonstrated no extension in 
technology. Where a later series of a particular aircraft 
model showed no incremental change in technology over a 
preceding one, the later series was eliminated. This 


procedure eliminated eight data sets. 


C. SUMMARY 

This methodology of data selection and sample reduction 
resulted in the selection of 47 distinct aircraft data sets. 
All aircraft were consistent with respect to performance, 
mission (fighter and attack) and flight profile (CTOL). 
Additionally, each aircraft selected provided significant 
advances in technology over previous models or series during 
the 1950 to 1980 time period. A lit of the 47 airncruame 
programs that comprise the final sample for this study is 


contained in the Appendix. 
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V. DEVELOPING REACH, STAND AND ADVANCE TECHNOLOGY MEASURES 


This chapter will describe the procedures used in the 
development of three measures of technology: REACH, STAND and 
ADVANCE. These technology measures will be employed in the 
analysis of cost in Chapter VI of this thesis. 

This section will first provide conceptual definitions of 
the three measures, REACH, STAND and ADVANCE, followed by the 
procedures used to create the measures. Each of the three 
measures are designed to reflect some aspect of technology em- 
bodied in a system and each will be developed for three 
different components of the aircraft. More specifically, the 
technology performance measures will be developed for: 

1. Aircraft PLATFORM (aircraft frame plus engine). 
2. Flyaway AIRCRAFT (platform plus systems). 
3. Aircraft Avionics and Weapon SYSTEMS. 
Alternative approaches to creating measures of STAND and 


BReVANCE will also be discussed. 


A. REACH 

REACH is a measure’of the total *echnology embodied in a 
system. Technology can be measured using data describing the 
"engineering" sophistication of a system (an input measure) or 
using data describing the performance of a system (an output 


measure). Chapter II discussed measures of aircraft system 
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performance and those measures are used here as measures of 
REACH. Three specific measures of REACH, for the three com- 
ponents of the aircraft, are defined as follows: 


1. PLATFORM REACH = AP (Airframe performance from Chapter 
seit) ws 


2. FLYAWAY REACH = ASP (Flyaway system performance from 
Chapter II). 


Sue SYSTEMS REACH = ASP/AP. 

The measure of SYSTEMS REACH is a constructed measure, 
designed to capture the performance enhancement achieved by 
adding weapons and avionics systems to an aircraft platform 
(resulting in the flyaway aircraft). This constructed measure 
assumes that flyaway aircraft performance is a multiplicative 
function of platform performance and, avionics and weapons 


systems' performance: 


FLYAWAY REACH = PLATFORM REACH X SYSTEMS REACH. 


Be STAND 

STAND is defined as the state of the art of technology in 
existence at the time a particular aircraft is first produced. 
Hence, STAND measures where technology "stands" at the time a 
new aircraft is created. STAND provides a reference point for 
determining whether new aircraft represent extensions in the 


existing state of the art. 
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1. Time Trend Approach 


Two alternative approaches exist for determining (and 
operationally defining) measures of STAND. The first 
alternative defines STAND as the trend in the state of the art 
of technology over time. A trend line was developed by 
fitting a regression equation to the various REACH measures 
defined above. Thus, STAND can be conceived of as the 
"expected" REACH of an aircraft, as a function of time. The 
specific procedures were as follows. 

Step 1. The REACH technology measures (PLATFORM, 
FLYAWAY and SYSTEM) were regressed separately against the 
START YEAR’ for each aircraft program. The REACH figures of 
merit were designated as the dependent variable and program 
START YEAR was designated the independent variable. 

Step 2. Analysis of the regressions resulted in the 
determination that the start year variable was highly 
Significant and produced a tight fitting model which could 
well explain the variation over time in REACH. Additionally, 
the models were tested for linearity and normal distribution 
with no exceptions noted. 

The regression analysis produced the following regres- 
sion equations and data analysis. Additionally, time trends 


can be observed graphically. The corresponding plot diagrams 


‘START YEAR is defined as the first year a program is in 
actual production. START YEAR data was obtained from the TASC 
data base. 
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show plots of PLATFORM TECH, SYSTEMS TECH and FLYAWAY TECH vs 
TIME. Figures 1-3 confirm the conclusions from the regression 
analysis that strong relationships exist between TECH and 
TIME: 

Step 3. The original start year data were then 
reinserted back into each regression equation to determine a 
predicted value for REACH at a given start year. These 
predicted values represent the state of the art of technology 
as reflected by the time trend line at a given start year. In 
short, these predicted values measure where technology stands 
at a given year. To summarize, measures of STAND were 
operationally defined as follows: 


1. PLATFORM STAND (R) = Predicted PLATFORM REACH from 
regression equation. 


oe SOS Jay STAND (R) = Predicted SYS LEM REACH from 
regression equation. 


3. FLYAWAY STAND  (R) 
regression equation. 


Predicted FLYAWAY REACH from 


Note: The (R) indicates that these measures of STAND are 
based on the time regression approach. 
2. Predecessor Aircraft Approach 

The second alternative defines STAND in relation to 

the highest !tevel of REACH achieved (all predecessor systems 

considered) prior to the start of the current aircraft 

program. This prior performance definition of STAND was 


calculated as follows. 
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TOPAD ZWOMWNDEY 


PLATFORM REACH = -8.61954 + 0.2971630(START YEAR) 


T-RATIO Paths L 


CONSTANT -3.39 0.001 
STARTYR 7.021 0.000 
STANDARD DEVIATION = 2.406 
ADJUSTED R-SQUARED = 51.1% 
F-TEST = 49.16 
CORRELATION = 0.723 
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Figure 1. Platform REACH vs STARTYR 
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FLYAWAY REACH = -30.94290 + 0.7906258 (START YEAR) 


T-RATIO P-lESa 


CONSTANT =O5 12 0.000 
STARTYR S50 0.000 
STANDARD DEVIATION = 4.780 
ADJUSTED R-SQUARED = 60.1% 


F=-Tioue—w O52 
CORRELATION = 0.781 
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FIgure 2. Flyaway REACH vs STARTYR 
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SYSTEM REACH = -1.03765 + 0.0362050(START YEAR) 


T-RATIO EalEor 


CONSTANT a a AA 0.000 
STARTYR 7.90 0.000 
STANDARD DEVIATION = 0.2601 
ADJUSTED R-SQUARED = 57.2% 
F-TEST = 62.44 
CORRELATION = 0.762 
= ‘ 
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- k 
0.60+ 2 * 
a * # 
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Figure 3. Systems REACH vs STARTYR 
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Step 1. The REACH performance measures were sorted by 
program start year in ascending order from 1950 to 1978. 

Step 2. Individual observations were made of all 
programs that preceded the current or selected aircraft 
program. 

Step 3. The highest level of REACH performance that 
had been achieved prior to the commencement of the program 
under consideration was selected and defined to be the 
relevant measure of where the state of the art of technology 
stood at the commencement of the new program under 
consideration. 

This procedure was applied to each of the these kinds 
of technology measures resulting in the following: 

1. PLATFORM STAND /P) = highest predecessor PLATFORM REACH. 
2. SYSTEM STAND (P) = highest predecessor SYSTEM REACH. 
3. FLYAWAY STAND (P) = highest predecessor FLYAWAY REACH. 
Note: The (P) designates that these measures of STAND were 


based on the predecessor aircraft approach. 


C. ADVANCE 

ADVANCE is defined as the extension in technology beyond 
the current state of the art. For any individual aircraft, 
ADVANCE equals the difference between the technology in the 


particular aircraft and the state of the art of technology 
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when the aircraft was produced. In short, ADVANCE = REACH - 
STAND. Since two approaches to measuring STAND were used, two 
alternative measures of ADVANCE result: 

1. The deviation from the time trend line. 


2. The difference between the actual REACH of the system 
and the prior highest level of REACH achieved. 


The measures of ADVANCE were created using two mathe- 
matical equations provided below: 


1. ADVANCE (R) = REACH minus STAND (R), derived from the 
regression time trend. 


2. ADVANCE (P) = REACH minus STAND (P), the highest level 
of REACH achieved prior to the start of the current air- 
eralrt. 

These procedures for calculating ADVANCE produced six 
distinct variables. 

1. PLATFORM ADVANCE (R). 

2. FLYAWAY ADVANCE (R). 

Sas SYSTEM ADVANCE (R). 

4. PLATFORM ADVANCE (P). 


5. FLYAWAY ADVANCE (P). 


6. SYSTEM ADVANCE (P). 


D. SUMMARY 
This chapter has described the procedures used to create 


three distinct technology measures for each aircraft: REACH, 


STAND and ADVANCE. 
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Each of these technology measures were calculated for each 
of three components of aircraft: PLATFORM, SYSTEMS and 
FLYAWAY. 

ADVANCE and STAND were derived from simple measures of 
REACH and REACH measures were defined by, or created by 
transformations of the performance figures of merit (AP and 
ASP) developed by TASC. Hence, all of the technology measures 
rest on the TASC methodology. 

Refer to the Appendix for the values of each technology 


measure referenced in this chapter. 


40 


VI. DATA ANALYSIS 


This chapter describes the procedures used in the testing 
for, and the analysis of, relationships which exist between 
production cost and the state of the art in technology for 
aircraft systems. These relationships are tested and analyzed 
using a series of simple and multiple regression techniques 
outlined in a manuscript by Dr. S.S. Liao (unpublished 


manuscript, Naval Postgraduate School, Monterey, CA). 


A. DEVELOPING THE HYPOTHESES 
Four hypotheses were developed which describe the expected 
relationships between technology and cost. 
The three hypotheses which are general in nature include: 
/m_oed,: Production cost = +f (REACH) 
(Production cost is expected to increase with the degree 
of technological complexity of the aircraft project.) 
fee Hos 6) Production cost = +f(STAND) 
(STAND reflects the average state of the art of 
technology at the time an individual aircraft was 
produced. Cost is expected to increase as technology on 
average becomes more complex. ) 
fee H,: Production™cost = +f (ADVANCE) 
(Production cost is expected to increase with the degree 
of technological e: tension of the program.) 
The final hypothesis developed was a control hypothesis 
which tested the difference in production cost between new 


aircraft designs and follow-on series of existing aircraft 


designs. Since production costs are expected to be higher for 
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new designs than for follow-on series, tests need to be 
developed which verify this hypothesis. 

4. H,: Production cost = +f(First Series of a New Design) 
(Production learning, which occurs in the first series 
of a new aircraft design, results in lower production 
cost in follow-on aircraft series. Hence, production 
cost is expected to be greater for new designs.) 

BB.” DETATLED HYPOTHESES 

In order to apply regression analysis to the four hypo- 
theses, each of the dependent and independent variables needed 
to be established. 

The four dependent variables were derived from the cost 
measures and were described in Chapter IV. These four 
variables include: 

1. AIRFRAME COST. 

Page PLAT EORMSGOST: 

35 SiO LEM Ces EL. 

4. FLYAWAY COST. 

For brevity, this thesis will use the general term "COST" 
to refer to the four costs. 

The three independent variables were derived from the 
technology measures established in Chapter V. These three 
variables include: 

le REACH. 


20.5 LAND. 


3. ADVANCE. 
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Note: Two alternative approaches to creating measures of 
STAND and ADVANCE were detailed in Chapter V: The regression 
(R) approach and the predecessor (P) approach. Tests were 
performed using both kinds of STAND and ADVANCE measures. R- 
type measures proved to be more significant during single 
variable regression testing. The P-type measures were 
determined to be insignificant in the single variable 
regression analysis. During the multiple regression testing 
phase, both R and P type measures were significant, but the 
R-type provided the highest significance levels. Given these 
findings, measures of STAND and ADVANCE based on regression 
approach were deemed to be superior. The analysis discussed 
in the following sections was conducted using R-type STAND and 
ADVANCE measures. 

To clarify the discussion, this study will use the 
following general terms to refer to the independent variables: 


1. REACH to refer to the three measures of the technologi- 
cal complexity existing within a project. 


2. STAND to refer to the three measures of the state of the 
art of technology at the time of program production. 


3. ADVANCE to refer to the three measures of the technology 
extension which exists within a program. 


In order to thoroughly test hypoth«ses one, two and three, 


the following regression models were constructed and tested: 
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1. PLATFORM COST = +f(PLATFORM REACH) 

+f(PLATFORM STAND) 

+f(PLATFORM ADVANCE) 

+f(PLATFORM REACH, PLATFORM STAND) 
+f(PLATFORM REACH, PLATFORM ADVANCE) 


+f£f( PLATFORM STAND, PLATFORM ADVANCE) 


2. SYSTEM COST +f(SYSTEM REACH) 

+f(SYSTEM STAND) 

+f(SYSTEM ADVANCE) 

+f(SYSTEM REACH, SYSTEM STAND) 
+f(SYSTEM REACH, SYSTEM ADVANCE) 


+f£ (SYSTEM STAND, SYSTEM ADVANCE) 


3. FLYAWAY COST +f(FLYAWAY REACH) 

+f£(FLYAWAY STAND) 

+f(FLYAWAY ADVANCE) 

+f(FLYAWAY REACH, FLYAWAY STAND) 
+f(FLYAWAY REACH, FLYAWAY ADVANCE) 


+f(FLYAWAY STAND, FLYAWAY ADVANCE) 


4. AIRFRAME COST was the only cost measure which had no 
corresponding REACH, STAND or ADVANCE technology measure 
associated with it. This was a direct consequence of 
the TASC research data; no AIRFRAME REACH measure was 
provided within the TASC methodology therefore, AIRFRAME 
STAND and AIRFRAME ADVANCE could not be developed. 


To solve this problem, this study evaluated the available 
REACH measures and determined that PLATFORM REACH provided the 
performance measure with the closest association with AIRFRAME 
Cosa. (All AIRFRAME COST models were tested using PLATFORM 
REACH, PLATFORM STAND and PLATFORM ADVANCE. ) 

The regression models developed for AIRFRAME COST 
ine LUGed: 


1. AIRFRAME COST 1£(PLATFORM REACH) 


+f(PLATFORM STAND) 

+f(PLATFORM ADVANCE) 

+f(PLATFORM REACH, PLATFORM STAND) 
+f(PLATFORM REACH, PLATFORM ADVANCE) 
+f(PLATFORM STAND, PLATFORM ADVANCE) 
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C. GENERAL STRATEGY 

The following steps were employed as a general strategy 
for testing the four central hypotheses. 

Step 1. Observe the data to identify existing statistical 
problems with each dependent and independent variable. This 
task entailed two procedures: 

1. Histograms were generated to test the variables for 
nermal G@lstribucion. This procedure produced normal 
distribution plots skewed to the left (higher cost) for 
the COST data. 

2. Plots of each variable against the STARTYR resulted in 
determinations that all the variables were linear, as 
desired, but the COST variable plots indicated that 
residuals were heteroscedatic (of non-constant 
variance). 

Step 2. Since two problems were noted with the COST 
variables, regression transformation procedures needed to be 
applied to transform the COST data to ensure a well defined or 
"tight" fitting regression model. The objective in 
transforming the dependent COST variable is to simultaneously 
"shrink" the effect of the skewed larger COST measures (i.e., 
normalize the variables) and correct the undesirable impact of 
non-constant variance on the regressions. 

Three regression transformation procedures were attempted: 

1. Natural logs were applied to COST. [log(COS”) } 

2. The square roots of COST were calculated. [sqr (COST) ] 


3. The reciprocals of COST were calculated. [1/COST] 
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The log(COST) regression transformation pEeeeet==—iaee aaa 
the tightest "shrinking" effect on the data, while (1/COST) 
produced the smallest "shrinking" effect. 

Each of the three transformations of the COST variables 
were again checked for normal distribution and non-constant 
variance. The log(COST) transformation corrected both 
problems and was selected to replace COST as the dependent 
variable in the regressions testing the central hypotheses. 

Step 3. This involved testing the data base to observe 
the relationships between log(COST) and the independent 
variables. This step is considered the core of the analysis 


of the four central hypotheses of this study. 


Dz TESTING HYPOTHESES ONE, TWO, THREESAND eS eer 

Three of the hypotheses of this study are « irected towards 
determining the relationships of REACH, STAND and ADVANCE to 
DEOdUCtElLONMecOscrS. Testing each of the variables both sin- 
gularly and through multiple regression establishes a 
comparative basis from which to select the optimum models. 

In order to test hypothesis four, a "dummy" variable, 
SERIES, was introduced as an independent variable for 
inclusion n the various COST regression models. SERIES was 
added to each regression model to form distinctly new 
regression models. The SERIES variable was essential to the 


testing of hypothesis four because it provided a means to 
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designate which programs were new production programs and 
which programs were follow-on production programs. 
The "dummy" SERIES variable was coded as follows: 


1. Initial series aircraft (first series of a new design; 
i.e., A-7A) were designated with a zero. 


2. Follow-on series aircraft (later series aircraft of an 
existing design; i.e., A-7E) were designated with a one. 


Given this coding for SERIES, the hypothesis calls for a 
negative relationship between COST and SERIES; follow-on 
series aircraft should cost less. 

The testing of the four hypotheses was completed in four 
phases of analysis. The four phases of analysis included the 
following. 

1. Phase One 

Phase one was deSigned to test the simple regression 
models (models including only one independent variable). This 
procedure ensured that all the dependent log(COST) variables 
in combination with the individual technology variables were 
linear, normally distributed, possessed no variance problems, 
and that regression residuals were independent. 

The test for linearity in regression analysis ensures 
that the independent variables do not need to be adjusted 
through regression transformation. This procedure was 
completed by plotting the independent technology measures 
against STARTYR. All independent variables were determined 


wempe linear. 
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The normal distribution was checked by the use of 
histogram plots. All independent variables were normally 
distributed. 

The variance was checked by viewing the plots during 
the linearity check for constant variance or non-constant 
(expanding or collapsing) variance. This procedure resulted 
in the finding that all independent variables exhibited a 
constant variance. 

The models regressing log(COST) independently on 
REACH, STAND, ADVANCE were tested for independence of 
residuals by the use of the Durbin-Watson test statistic. 
Each regression model produced Durbin-Watson statistics which 
indicated no strong relationship among residuals. This 
indicates that the residuals were independent of the log(COST) 
measures and no adjustments to the data were needed. 

At this point, all regression models were analyzed for 
significance prior to further testing to eliminate redundant 
variables. 


STAND was found to be significant as a predictor of 


log (COST). R-squared (adjusted) values ranged from 38.5 to 
Areas All T-ratios and P-tests were evaluated as 
Significant. Additionally, the F-tests were significant, 
ranging) frome14.1 ° @teme2emce This provided some initial 


evidence in support of hypothesis two. 
ADVANCE was found to be a significant and valid 


predictor of log(COST). R-squared (adjusted) values ranged 
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from 18.6 to 20.9%. The T-ratios were significant and the F- 
peaeenanced from 7-18 to 109758 This" provided some initial 
evidence in support of hypothesis three. 

REACH was found to be a significant predictor of 
log(COST). The R-squared (adjusted) values ranged from 46.2 
mon 62.3%. The fact that the regression models resulted in 
high significance levels demonstrated hypothesis one was 
valid. But, further analysis of the REACH models indicated 
that REACH provided no additional information useful for 
explaining production cost beyond that contained in STAND and 
ADVANCE. This is because REACH is a direct linear combination 
of STAND and ADVANCE and is considered a redundant measure. 
Due to this finding REACH was eliminated from further testing. 

2. Phase Two 

This phase required the use of multiple regression 
testing, where SERIES (independent variable) was added to the 
log(COST) models with either STAND or ADVANCE. (For example, 
moe COST = £(SYSTEM STAND,SERDIES); SYSTEM COST = f(SYSTEM 
ADVANCE,SERIES); ...; etc.) The objective here was to provide 
an initial test of hypothesis four and to observe the effect 
on the relationship between COST and STAND or ADVANCE with 
SeRtES controlled. 

Multiple regression testing of STAND and ADVANCE in 
combination with SERIES produced models with improved 
Significance. R-squared values improved by 8-18% along with 


improved T-ratios and P-tests. All models were evaluated and 


49 


determined to be highly significant, the residuals were 
normally distributed and the models explained a large propor- 
tion of the variance in production cost. R-squared (adjusted) 
values ranged from 28.4 to 61.1%. This phase of study 
provided an initial indication that hypothesis four was valid. 
3. Phase Three 

Phase three introduced the concept of testing STAND 
and ADVANCE together in multiple regression analysis modeling. 
The objective here was to determine if the joint explanatory 


ability of the two technology measures lead to improved 


predictiiens of BeosT- Four models were tested during this 
phase: 
lige log(AIRFRAME COST) = +f(PLATFORM STAND,PLATFORM AD- 
VANCE)°*. 
Page log (PLATFORM COST) = +f (PLATFORM STAND, PLATFORM 
ADVANCE). 


cm log(SYSTEM COST) = +f(SYSTEM STAND,SYSTEM ADVANCE). 
4. log(FLYAWAY COST) = +f(FLYAWAY STAND, FLYAWAY ADVANCE). 
When analyzed, these regression models consistently 
demonstrated positive coefficients for STAND and ADVANCE, 
highly significant T-ratios, and F-tests, along with strong 
improvements to the R-squared values. R-squared (adjusted) 


ranged from 48.3 to 66.9%. 


‘Recall that no AIRFRAME REACH measure was provided and 
therefore, PLATFORM REACH was substituted as the technology 
measure with the closest association to AIRFRAME REACH. 
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These results provided the basis for concluding 
hypotheses two and three were valid. Production cost does 
increase with improvements in the state of the art in 
technology and the degree of technological extension within a 
program. 

4. Phase Four 

Phase four represented the re-introduction of the 
SERIES variable to the phase three regressions. The purpose 
here was threefold: First, to determine if the results found 
for STAND and ADVANCE in the phase three regressions continued 
to hold when SERIES was controlled. Second, to provide a re- 
test of hypothesis four in conjunction with more complete 
models. Third, to determine if R-squared (adjusted) of the 
models could be improved. The significance of each log(COST) 
model improved with regards to T-ratios, P-tests and F-tests. 
Additionally, R-squared improved 3-7% depending on the 
specific model. 

The coefficients for STAND, ADVANCE and SERIES were 
Significant, with the hypothesized signs, in each of the 
models (with the exception of SERIES in the SYSTEM COST 
model). 

These multiple regression models were considered to be 
"optimal" given the available data. These models maximally 
use the information contained in the three available 


predictors to explain production cost. 


Bal 


E. OPTIMUM REGRESSION MODEL DISPLAYS 

The following four regression models are provided with 
relevant statistics and visual plots of the regression 
residuals vou These data are displayed to support this 
study's results and conclusions concerning the selection of 


the optimum regression models in Figures 4-7. 


F. CONCLUSIONS 

Note that model 2 explains a greater proportion of 
PLATFORM COST than does model 1 for AIRFRAME COST. Since the 
two models contain the same predictor variables, this result 
1s consistent with PLATFORM STAND and PLATFORM ADVANCE being 
Surrogates for frame technology, and measuring technology 
state of the art and extensions for airframes with "noise." 

Al::o note that the regression for SYSTEM COST yields the 
poorest result. This is expected given that SYSTEM COST< 
SYSTEM STAND and SYSTEM ADVANCE are all derived measures, 
constructed from other available COST and technology measures. 

The analysis of hypothesis one indicates that the overall 
technology embodied in an aircraft, as measured by REACH, is 
highly associated with production cost. The analysis, 
however, indicates that REACH is a redundant variable when 


ADVANCE and STAND are available. 


“y. is defined as the predicted value of the regression 
equation. 
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PRP RAME COST — +£(STAND, ADVANCE, SERIES) 


LOG(CACF) = -0.127 + .0857(STAND) + .O866(ADVANCE) - 
0.206(SERIES) 


STANDARD DEVIATION = 0.2045 


T-RATIO P-TEST 
CONSTANT -0.90 0.375 
STAND 6.18 0.000 
ADVANCE 4.97 0.000 
SERIES Seo 0.008 
R-SQUARED (ADJUSTED) = 67.6% 
F-TEST = 24.62 
DURBIN-WATSON STATISTIC = 1.89 
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Figure 4. Airframe Cost Residuals vs Y, 
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PLATFORM COST = +f(STAND, ADVANCE, SERIES) 


LOG(CACE) = -0.08 + .0914(STAND) + 


0.214 (SERIES) 


STANDARD DEVIATION = 0.1807 


IT-RATIO P=frESse 
CONSTANT -0.64 0.525 
STAND 7.47 0.000 
ADVANCE 5.24 0.000 
SERIES = snp 0.002 
R-SQUARED (ADJUSTED) = 73.6% 
FeTTo, == 32,62 
DURBIN-WATSON STATISTIC = 1.69 
CORRELATION: 
LOGCACE STAND ADVANCE 
STAND 0.580 
ADVANCE 0.458 0.000 
SERIES =0.477 -0.045 =O0.2i2 
= * 
_ * 
1.5+ * 
a * * * 
= * * * xk & 
= * x * * 
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Figure 5. Platform Cost Residuals vs Y, 
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SYSTEM COST = +f(STAND, ADVANCE, SERIES) 


LOG(CACS) = -1.53 + 1.22(STAND) + .574(ADVANCE) - 
0.2(SERIES) 


STANDARD DEVIATION = 0.4176 


T-RATIO Paco 
CONSTANT = ore 0.000 
STAND 2.33 0.000 
ADVANCE 2222 0.034 
SERIES Ae So 0.182 


R-SQUARED (ADJUSTED) = 49.8% 
Boetbol — 11.58 
DURBIN-WATSON STATISTIC = 1.89 


CORRELATION: 
LOGCACS STAND ADVANCE 
STAND Se OlG 
ADVANCE 0.242 0.000 
SERIES =O.2 16 =O U4 ss =e 1 
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1.5+ * * 
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Figure 6. Systems Cost Residuals vs Y, 
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FLYAWAY COST = +f£(STAND, ADVANCE, SERIES) 


LOG(CACA) = 0.375 + .0419(STAND) + .0393(ADVANCE) - 
0.241(SERIES) 


STANDARD DEVIATION = 0.1847 


T-RATIO P=TES® 
CONSTANT S07 0.000 
STAND Sapo 0.000 
ADVANCE 6.5L 0.000 
SERIES -4.00 0.000 


R-SQUARED (ADJUSTED) = 76.8% 
F-TEST = 41.91 
DURBIN-WATSON STATISTIC = 1.77 


CORRELATION: 
LOG (CACA) STAND ADVANCE 
STAND 0.631 
ADVANCE 0.480 0.000 
SERIES =O. 95 -0.045 =O. 100 
- * 
1.5+ x * 
— * 2 x & 
- x * 
= * * 
= * * *k* 
0.0+ * * * 
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Figure 7. Flyaway Cost Residuals vs Y, 
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The analysis of hypothesis two indicates that production 
costs do indeed increase with the increase in the state of the 
art in technology. The findings for STAND (R-type) clearly 
support this conclusion. 

Analysis of hypothesis three leads to the conclusion that 
ADVANCE (R-type) is also a significant predictor of production 
cost. Cost increases as a function of the degree of techno- 
logical extension of a program. 

Hypothesis four was clearly demonstrated throughout 
testing by the improvement of R-squared once the SERIES vari- 
able was added. The only model where this observation is weak 
is in the SYSTEMS COST model. The t-ratio and p-test indicate 
m@atce cERIES is insignificant, but the addition of SERIES 
improved the R-squared (adjusted) value by 1.5%. This follows 
the findings noted for the other models, only to a lesser 
degree. Follow-on series of existing designs do produce lower 
production costs and new design programs result ina "premium" 


mieproduction cost. 


G. SUMMARY 

This chapter has described the three central hypotheses of 
this study and the procedures used to test the relationships 
which exist between aircraft production costs and technology 
variables. 

Multiple regression testing, being the test method of 


choice, provided significant findings during the analysis. 


a 


and direction of further work. 
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VII. CONCLUSIONS AND RECOMMENDATIONS 


A. CONCLUSIONS 

The methods and procedures employed within this study 
effectively demonstrate that relevant models can be developed 
for describing the relationships which exist between measures 
of the technology in complex aircraft systems and production 


GOst. 


oe DATA 

The building of accurate and valid technology measures is 
critical to effective research in this field. Without 
accurate data, problems of "noise" or erroneous models will 
result. 

Accurate cost records must be retained within DOD. A 
uniform system of accounting standards has only recently been 
employed within DOD. This has only partially solved the 
problem of accurate records. The cost records are, for the 
most part, not computerized for ease of access and are not 
easily applied to analysis. Without accurate data uniformly 
collected by all branches of DOD future attempts to develop 
models explaining cost will be difficult. 

This study encountered a problem in attempting to model 
SYSTEMS COST. This can, in part, be attributed to the lack of 


accurate cost data for SYSTEMS COST and the need for the study 


5g 


to reconstruct SYSTEMS COST and SYSTEMS STAND and  -ADVAes 
measures from other available data. Additionally, no measure 
of AIRFRAME technology was available, so a surrogate measure 


was used in the analysis of AIRFRAME COST. 


C. METHODOLOGICAL REFINEMENTS 

When working with regression analysis techniques, it is 
recommended that a refined application of variable analysis be 
applied prior to working with the data. The dependent and 
independent variables must be evaluated for linearity, 
constant variance, normal distribution and independence of 
residuals. Within this study, those determinations were 
critical to generating the most accurate models. Several 
adjustments were made to the data, based on the problems found 
by using these techniques. 

Transformation techniques were central to resolving these 
initial problems. Transformation of the cost variables by 
calculating the natural log for costs, "cleaned up" the data 
base, ensuring valid test results. It is recommended that all 
future test involving relationships between cost and perfor- 
mance variables within complex system be initially evaluated 
and adjusted where 2>cessary using similar transformation 


techniques. 


D. CHOICE OF “PREDICTOR VARTAGEES 
Initial regression analysis models demonstrated that in- 


clusion of REACH, STAND and ADVANCE within the same regression 
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model produced incompatible results. This was the primary 
reason for ultimately dropping REACH from the analysis. (REACH 
was redundant.) Additionally, several weak variables were 
dropped from the analysis [STAND (P) and ADVANCE (P)]. Each 
application of these weak variables produced sharp reductions 
in significance of the models. Based on these observations 


the insignificant variables were removed from testing. 


E. HYPOTHESIS TESTING AND MODEL CONSTRUCTION 

After the optimum independent variables were established, 
concentrated testing of those variables produced the models 
discussed in Chapter VI. All models were highly significant, 
linear, normally distributed, possessed constant variance and 
independence. 

Analysis of the data with regard to the central 
hypotheses, established that specific relationships do exist 
between aircraft system cost and the technology measures de- 
veloped for this study. STAND and ADVANCE, in combination 
with the SERIES "dummy" variable were the measures that most 
successfully explained production cost. 

The accuracy of these results rests on the accuracy of the 
TASC study and the methodologies TASC used to deve'’op the 


initial measures of production cost and aircraft performance. 


F. RECOMMENDATIONS 
Recommendations for further study and potential thesis 


research topics include the following: 
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1. Test for relationships within other mission and flight 
profile areas (e.g., bombers, helicopters, or patrol 
AlE Crate 

The researcher will need to adjust the data base to a new 
"baseline" aircraft. This realignment will validate the 
performance figures of merit tables. Considerations would 
include selecting aircraft of similar design and performance 

characteristics (e.g., VTOL or STOL). 
The value of such a study would be the extension of work 
on technology/cost relationships into Re data base to 


determine if relationships similar to the ones found in this 


study can be generalized. 


2. Additional research is recommended for refining this 
study every ten years or whenever significant advances 
in future aircraft technology and production 


developments are achieved. 

This project would include a comparative review of this 
study comparing the future trends of aircraft cost vs perfor- 
mance. 

3. A detailed review of the TASC methodology for developing 
cost measures and performance measures is advised. This 
study would have two primary objectives: 

a. Develop an accurate SYSTEM COST measure. 
Jaye Develop an accurate AIRFRAME TECHNOLOGY measure. 

The Y‘enefit of such a study would be the elimination of 
the "noise" or inaccuracy which exist within this study. The 
ultimate goal would be an optimal set of aircraft cost/ 


performance relationship models which were not the direct 


result of ad hoc research techniques. 
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G. SUMMARY 

This thesis could be used as the foundation for future 
research on the relationships between aircraft system costs 
and their associated advances in technology. 

The results of this study answer many academic questions 
concerning these relationships. The use of this study's 
regression models for DOD program management is not 
recommended until the "noise" is eliminated from the data 


base. 
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APPENDIX 


The Appendix contains the data base obtained from the TASC 


Research Methodology (Program COST, REACH, and STARTYR). The 


log cost, technology measures (STAND, ADVANCE) and SERIES 


(dummy variable) are developed measures used throughout this 


study. 
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AIRFRAME PLATFORM FLYAWAY SYSTEM 
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